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for  all  weapon  groups)  and  so  for  efficiency  the  variable  N0WPS(2)  Is 
used.  While  the  expected  value  of  (Al£RREST(l ))^  Is  the  same  as  E 

2 ® 
(ALERREST(J))  , the  variance  of  the  latter  version  is  much  less,  and  it 

is  therefore  preferable  as  an  estimator  of  the  expected  integration 

period,  EXPINTPD  and  is: 

EXPINTPD  - NCMPSa)(ALERBESTa)^)*NTGTS) 

To  allow  the  possibility  of  using  integration  periods  either  longer  or 
shorter  than  the  theoretical  EXPINTPD,  a desired  longest  integration 
period  DESINTPD  is  defined: 

DESINTPD  *=  EXPINTPD*RATIOINT 

where  RATIOINT  is  an  adjustable  input  parameter.  A low  value  allows 
higher  sensitivity  without  oscillations  in  the  values  of  the  Lagrange 
multipliers  but  too  low  a value  makes  convergence  to  the  correct  stock- 
pile sensitive  to  statistics  of  the  target  list.  If  the  target  list 
contains  targets  with  heavy  ballistic  missile  defenses  or  if  a large 
fraction  of  the  weapons  are  assigned  by  the  fixed  assignment  capability, 
this  parameter  value  should  be  increased  (to  4.0  or  above  if  necessary). 
If  this  period  were  used  exactly  in  setting  the  rate  of  change  of  the 
target  weight  (i.e.,  WRATE  = 1.0/DESINTPD) , the  WRATE  would  never  become 
exactly  zero  as  is  required  for  a constant  target  weight.  Obviously 
when  the  change  in  the  target  weight  becomes  small  over  a full  pass,  the 
WRATE  should  be  allowed  to  go  to  zero.  Therefore  in; 

WRATE  - (1.0/DESINTPD)  -(2.0/(NTGTS*RATI0INT)) 

Che  term  (2./NTGTS*RATIOINT))  is  subtracted,  and  if  the  resulting  WRATE 
is  negative  it  is  set  to  zero.  To  avoid  a situation  where  large  errors 
cause  the  integration  period  to  become  ridiculously  small,  a limit  that 
WRATE  s .07  Is  set. 

Moreover,  after  the  allocation  is  well  under  way,  PROGRESS  .5,  the 
value  of  WRATE  is  not  allowed  to  increase.  In  the  program  WTRATE(INTPRD) 
is  used  as  a multiplier  of  the  target  weight;  therefore  we  add  1.0  to 
WTRATE  to  obtain  a suitable  multiplier  for  the  longest  period  NINTPRD. 

The  values  for  the  three  WTRATE  variables  are; 

WTRATE (3)  - 1 + WRATE 

RTNTPRD- 1 

WTRATE  (2)  * 1 + WRATE  + + RINTPRD 

RTNTPRD- 1 

WTRATE (1)  - 1 + WRATE  + + 2.*RINTPRD 

Input  parameter  RINTPRD  is  an  approximate  ratio  between  rate  of  change 
of  target  weights  between  different  integration  periods.  An  increase  in 
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this  parameter  Increases  the  sensitivity  ot  the  multiplier  adjustment  to 
recent  target  experience. 

To  restate,  Legrange  multipliers  are  recomputed  based  on  variable  PRO- 
GRESS end  after  a specific  number  of  targets  have  been  processed.  The 
adjustment  Is  based  on  maintaining  statistics  of  weapon  allocation  rates. 
The  differences  in  true  and  observed  rates,  along  with  Input  sensitivity 
parameters,  make  up  the  formula  for  multiplier  adjustment. 

A. 6 Derivation  of  Formula  for  Correlations  In  Weapon  Delivery  Probability 

An  exact  calculation  of  the  probability  of  target  survival  when  It  Is 
subject  to  attack  by  correlated  weapons  Is  very  lengthy.  Both  the  con- 
ventional statistical  analysis  and  the  Bayesian  Incremental  Information 
approach  have  been  examined.  Both  approaches  for  each  time  and  hardness 
require  the  calculation  component  of  the  Interaction  terms  between  each 
weapon  to  be  added  with  all  possible  combinations  of  the  weapons  already 
on  the  target.  Thus  the  completely  rigorous  calculation  would  be  Imprac- 
tical In  a rapid  response  allocator.  The  method  used  here  Is  based  on 
an  approximation  derived  from  the  properties  of  the  log-gaimna  distribu- 
tion. 

When  a group  of  weapons  share  a common  failure  risk  the  probability  ot 
success  Is  likely  to  be  either  high  or  low  for  all  weapons  collectively. 
Thus  the  probability  of  success  can  itself  be  thought  of  as  a random 
variable.  For  any  chance  value  of  this  overall  random  variable  there 
will  exist  the  usual  Independent  probabilities  for  Individual  weapons. 
However,  on  one  trial  the  overall  success  probability  for  the  group  ot 
weapons  may  be  90%,  while  In  another  trial  It  may  be  30%  depending  on 
the  particular  success  probability  drawn  for  the  trial. 

The  following  mathematical  model  has  been  developed  to  deal  with  this 
type  of  problem.  We  asaunw  that  the  probability  of  survival  of  a tar- 
get with  respect  to  the  1^  weapon  Is  itself  a random  variable  S of  the 
form 


where  the  are  random  variables  drawn  from  a known  distribution. 

If  two  weapons  are  Involved,  then  the  probability  of  survival  with 
respect  to  both  can  be  represented  by  the  random  variable  S']'; 

-(X  + X ) 

However,  the  random  variables  Xj^  and  Xj  may  or  may  not  be  Independent . 
If  they  are  not  Independent  then  of  course 
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11  the  are  Independoat ly  drawn  from  a known  two-parameter  family  of 
distribution  with  a convolution  property,’*'  then  the  distribution  of 
+ X^  will  ot  course  be  a member  of  the  same  diatribution  family.  More- 
over, since  any  probability  distribution  for  the  implies  a distribu- 
tion lor  the  corresponding  Si,  the  distribution  for  S^Sj  can  be  calcu- 
lated and  the  value  for<StSj>can  be  computed. 

The  gannna  diatribution  given  by; 

j^a^-X/b 

P(X)dx  ■ --rj dx  for  X > 0 

b*  ^r(a  + 1) 

P(X)  - 0 for  X s 0 

is  a well  known  two-parameter  diatribution  with  the  required  convolu- 
tion property. 

The  gamma  diatribution  ia  unique  among  convolving  two-parameter  diairi- 
butiona  in  that  the  expected  value  of  e“^  ia  easily  computed.  This  pro- 
perty is  particularly  important  for  QUICK  since  the  damage  function  per- 
forms a computation  of  this  value  many  times  during  the  allocation.  The 
expected  value  of  e“^  is  given  by. 


<e 


/ 


P(X)e  ^dX 


which  can  be  written 


<S>«*<.e 


(b  + l) 


a + I 


This  diatribution  is  valid  for  b >0  and  a > - 1.  It  has  a mean 
= b(a  + 1)  and  a variance  - b^(a  + 1). 


Since  this  distribution  is  completely  defined  by  the  mean  and  variance, 
the  actual  probability  distribution  of  S can  be  computed  at  any  time  so 
long  as  a record  of  the  mean  and  variance  of  the  distribution  is  main- 
tained. We  now  observe  that; 

2 2 

a + 1 - ft  /<r 


A probability  distribution  is  said  to  "convolve"  when  the  convolution 
of  any  two  distributions  in  the  family  (i.e.,  the  distribution  of  the 
sum  of  the  two  random  variables)  is  itself  a member  of  the  same  family. 


475 


and 


2 

b “ <T  /p 

ao  the  expected  value  of  S can  be  written 


Jhis  distribution  is  sufficiently  flexible  to  include  almost  any  shape 
distribution  of  interest.  For  a small  the  distribution  in  S approxi- 
mates a gaussian  centering  on  some  specific  survival  probability.  As 
the  a is  increased  the  distribution  widens,  so  that  it  can  approximate 
a uniform  probability  from  zero  to  one,  or  a sloping  probability  wltlt 
more  weight  on  zero  or  one.  In  the  limit  of  very  large  a the  distribu- 
tion consists  essentially  of  spikes  of  different  weight  at  zero  and  one. 

If  we  were  dealing  with  Independent  weapons  we  could  calculate  the  para- 
steters  for  the  multiple  weapon  distribution  from  those  for  the  single 
weapon  distributions  simply  by  making  use  of  the  additivity  of  the  mean 
and  the  variance.  Specifically  the  mean,  distribution 

and  the  variance  CjT  would  be  given  by: 

2 ,,  2 
Ot  ■ ^ 

The  expected  value  of  target  survivability  Sj  for  the  naw  distribution 
would  then  be  obtainable  through  the  equation; 


However,  the  variance  is  directly  additive  as  above  only  if  the  weapons 
are  really  independent.  To  introduce  the  possibility  of  correlations  we 
will  write  the  variance  as  follows; 


V 

i 
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where  the  quauCLty  Iji  represents  the  correlstJoii  between  the  weapons. 

In  the  special  case  of  uncorrclated  weapons,  r^j  " for  I J and  I lor 
I « 1,  which  Is  identical  with  the  previous  fonn. 

I'hlH  approach  of  arbitrarily  introthiclng  the  cross  temis  In  this  lorrau- 
lailon  to  approximate  the  actual  correlations  Is  exact  so  long  as  the 
correlations  are  of  such  a form  that  the  distribution  of  X remains  a 
gamnta  distribution.  To  the  extent  that  the  actual  correlations  cause 
departures  front  the  Tdlstrlbution  the  approximation  Is  in  error.  The 
correlation  model  thus  amounts  to  the  assumption  that  correlations  can 
be  adequately  moulded  without  going  outside  the  log-gaiimta  distribution. 

For  Implementation  It  seems  appropriate  to  Introduce  an  additional  sim- 
plification. In  the  foregoing  formuatlon  the  magnitude  of  the  penalty 
for  using  correlated  weapons  will  depend  not  only  on  the  sire  of  the 
correlation  and  the  kill  probability  for  the  correlated  weapons,  but 
also  on  the  shape  of  the  distribution  for  the  success  probability  for 
each  weapon.  This  shape  dependence  Introduces  a complicating  variable 
which  undoubtedly  exists,  but  for  which  it  would  not  be  easy  to  get  data. 
It  therefore  seems  desirable  to  eliminate  this  factor. 

This  can  be  done  by  standardizing  on  a single  shape  factor  for  all  cal- 
culations of  the  effects  of  correlations.  It  is  easiest  to  do  this  by 
considering  only  distributions  with  a very  large  a,  which  are  essentially 
spikes  on  zero  and  one.  This  choice  tends  to  exaggerate  the  Importance 
of  correlations  (and  this  fact  should  be  borne  In  mind  In  assigning  the 
correlations  for  the  war  game)  but  It  significantly  simplifies  the  data 
required,  as  well  as  the  computation  of  the  payoff. 

In  the  limit  of  large  <T  the  quantity  approaches  Infinity  while 

the  quantity  compensates  to  maintain  the  correct  value  of 

-in  <Si> 

2 

To  Illustrate,  the  transition  to  this  limit  we  let  bj^  » define 

« bjln{b^  + 1) 

Then 

-in 

so: 

[-in  <S^>] 

and 

- '>1^1  [-'"  '*!>] 
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tornuilH  tor  obtiilnlnx  th«t  oxpoctot)  vahio  of  S.^,  can  n«'w  ho  written 

2 

Mr‘ 

“in  <S  > *•  — r it»<h  ♦ 1) 

* a ^ ‘ 

T 

anvi  Hiihatitut  Ing, 


M-i-  - at  l\  ,(y, 


we  obtain; 


“In 


K <K  j)^  (4.,(-,^  ')) 

<S.>]  <“?]''=■ 


We  now  aenlKn  to  all  wea^ionM  Che  tiame  value  ol  bj , no  that  all  bj  are 
equal  ami  all  are  aqua  I and  we  obtain; 


in(b^.  + l> 


[ V (“in  <S^>  )]' 


^'T  in^FpnrV  V V ( Tj  ^ (“in  < S^>  ^ 

If  wo  nvurf  let  b^  a\>|>roacb  (ntinlty  the  I'atlo  ol  the  two  lo^arl t limio 
quant (t ion  will  approach  t.  Note  that 
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HO 


* \' 

•'M, 


It 


tolliwa  that  b,j.  > b^  and  b,j,x  ’I*  b^,  where  t|  in  the  i^umbor  of  weapons. 


Tho  limiting  case  h 


' b^  ocoura  when  all  1'^  ^ - I ami  all  avo 
2 

equal.  Therefore  so  lou>j  as  bj  » ’1*"  the  ratio  of  the  luitarithina  will 

ho  essential Iv  I,  ami  in  tho  limit  as  hj  appivaohos  infinity  wo  obtain 
simply; 


-in  <«.,,>• 


.'•“in<S> 
1 — •172 


Pur  compactness  ot  notation  let  us  lilentlfy  the  quantities 
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- (-in  <Sj  > ) 


«nd  - (-in  < > ) 


Then  aincc 


i,1 


■ I If  t ■ j we  obtain 


^ Pt 

hill 


AW  '■‘jW 


TTT 


or  equivalently 


"^T7T 


\ 1/2 


J<i 

This  form  has  the  basic  properties  desired.  Notice  there  is  only  one 
interaction  term  between  each  pair  of  weapons.  In  addition,  only  two 
sums  need  to  be  maintained  to  compute  fi,^.  These  are; 


MU  - Eji, 
i 


SIG 


1/2 


From  these  the  value  is  given  simply: 
- (MU)^  / (MU  + SIG) 


The  addition  of  any  new  weapon  adds  one  term  t ' rhi‘  MU  sum,  and  several 
terms  to  the  SIG  sum. 

The  computation  of  the  first  sum  is  trivial;  uowevor,  before  the  second 
one  can  be  used  it  is  necessary  to  provide  a pra  tical  method  of  esti- 
mating 

We  recall  that  the  array  RISK  (A>G,J)  was  computed  as  an  estimate  of 
shared  risk,  and  that; 

RlSK(A,G,sl)  - r SM(L)*SMAT(A,L) 

L-1,5 

For  a particular  weapon  G and  hardness  component  J,  this  relation  might 
look  as  follows:  (A  is  a weapon  attribute  index;  L is  a failure  mode 
index. ) 
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A - 

1 

2 

3 

4 

5 

6 

L 

SM(l.) 

All 

Group 

Reg 

Class 

Type 

Alert 

Independent  Risk 

1 

-LOGF(DBL)  - .20 

.00 

.10 

.10 

.10 

. 10 

.40 

.20 

2 

-LOGF(CC)  - .00 

.00 

.10 

.30 

.10 

.10 

.30 

.10 

3 

-1.0GF(REL1  - .05 

.00 

.05 

.00 

. 10 

.20 

.00 

.65 

4 

-1,0GF(PEX)  - .20 

.00 

.00 

.10 

.20 

.20 

.00 

.50 

5 

-LOGF(STK)  ‘ .02 

.00 

.00 

.00 

.00 

.00 

.00 

l.OO 

RISK(A.G,J) 

.000 

.0225 

.040 

.065 

.070  .08 

. 1925 

Thus  the  SMAT  array,  a user  input  estimate  of  shared  risk,  is  used  sim- 
ply to  divide  the  five  types  of  risk  SM(L)  between  the  Independent  weap- 
on risk,  and  the  six  factors  A that  any  two  weapons  might  have  in 
common.  Ute  total  RISK  over  all  A plus  the  independent  risk  is  of 
course  equal  to  the  sum  of  SM(L).  Wc  are  now  interested  in  using  the 
RISK  array  to  derive  reasonable  values  for  the  correlation  coefficients 

The  RISK  array  thus  represents  the  amount  of  the  risk  for  each  weapon 
that  is  likely  to  be  correlated  with  other  weapons  of  the  same  class, 
type,  etc. 


The  correlation  coefficients  should  reflect  the  shared  risk.  It  two 
weapons  have  only  two  attributes  A In  common  then  the  shared  risk  should 
come  only  from  these  two  common  attributes.  Moreover,  the  amount  of 
risk  that  can  be  shared  on  the  basis  of  one  attribute  cannot  exceed  the 
minimum  risk  associated  with  that  attribute  for  either  weapon.  There- 
fore, to  estimate  the  maximum  risk,  Y.  , that  can  be  shared  by  two 
weapons,  1 and  J,  we  define; 


or  GAM(k,J) 


5:  <5  (A^,Aj)*Min  RISK(Aj^,Gj^,J)RlSK(Aj,Gj,J) 


where  d - 0 if  A^^  -f  Aj  and  d - 1 if  A^^  ■ A^. 


The  coefficients  however  must  never  exceed  1.0.  Therefore  it  is 
appropriate  to  divide  the  shared  risk  GAM(i,J)  by  5!  SM  to  obtain  a nor- 

I, 

mallzed  fraction  guaranteed  to  be  less  than  1.0. 


Thus  the  form  of  the  second  summation 


SIG 


' - r 2(^  )i/2  r.  ,(m.)i/2 

i J<i  ' •* 


would  become 


SIG-v  V 2(^  ) 

i J<i  ^ J 


1/: 


I 
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lU>wi'vov,  thl8  form  Involve*  square  roots  which  are  inconvenient.  More- 
over, It  represents  an  upper  limit  of  correlation.  We  can  reduce  the 
sl/e  ot  the  overestimate  by  using  the  largest  (or  maximum)  T,  SM;  l.e., 

1. 

iisln^  the  least  reliable  weapon  for  normalisation.  In  addition,  we  can 
slmplily  tlie  fonn  and  proy;^de  for  the  removal  of  square  roots  If  we  also 
multiply  by  (Mmln  ^^max)^'"*  (Thii*  is  * factor  less  than  1.0  that  has 
the  effect  of  reducing  slightly  the  assumed  correlation  between  weapons 
ot  very  dltferent  overall  et fectlvaness, ) 


With  these  changes,  the  equation  for  SIG  takes  tht.  form  of 


SIG 


T 

i j<i 


1/2 


GAMd.J) 

Max  F SM 

L 

yMmax  j 

/ 

1/2 


The  form  In  braces  la  still  guaranteed  to  fall  between  zero  and  1.0. 

It  represents  the  actual  form  for  used  In  the  present  version  of  the 
Allocator.  Tills  form  has  a computational  advantage  In  that  It  simpli- 
fies the  calculation  of  SIG.  Assume  that  Then 

v sM.>r 

L h 


SIG  - 


This  reduces  to; 

SIG  - 2*GAM(k,l)*MlN 

f » J 

This  is  the  actual  form  used  computationally.  (For  each  weapon  group  G 
the  quantity  M/  T SM  Is  Identified  In  the  FORTRAN  as  SS1G(G,J).) 

I, 


r SM. 
¥ ^ 


SM, 


and  so 


1/2 


GAMlixil 


F SM. 


The  specific  formula  used  for  the  terms  In  SIG  Is  of  heuristic  origin 
and  is  obviously  somewhat  arbitrary.  It  Is  Justified,  In  the  final 
analysis,  by  the  fact  It  Is  fairly  simple  and  that  It  works.  'lire 
resulting  kill  probabilities  produce  realistic  cross  targeting,  and  In 
cases  where  these  probabilities  can  be  compared  with  a rigorous  statis- 
tical model  of  correlations.  It  produces  a satisfactory  approximation 
to  the  kill  probability. 


481 


In  sunmary,  the  mathematics  is  as  follows:* 

For  a single  weapon  let 

SSK  “ single  shot  kill  probability,  and  let 
SSS  • single  shot  target  survival  probability 
then  SSK  is  given  by 

-LOGF(SSK)  - I'  SM(L) 

ii 

As  usual,  SSS  - 1.0  - SSK,  and  we  define  or  MUP  for  group  relative 
to  hardness  component  J as: 

MUPIG.J)  “ -LOGFCSSS) 

We  also  define  SSIG(G,J)  as; 

SSIG(G,J)  - LOGF(SSS)/LOGF(SSK)  - MUP(G,J)/  ^ SM(L) 


Finally  wc  define  RISK(A,G,J)  as: 

RISK(A,G,J)  - E SM<L)*SMAT(A,L) 

L«1.5 

The  preceding  three  arrays  (underlined  for  emphasis)  are  the  main  input 
for  the  estimation  of  kill  probabilities. 

The  target  survivability  relative  to  multiple  weapons  Sj  is  given  by 


2 

where  pT  - (MU)  / (MU  + SIG) 

and  where  MU  “ E p,  “ E MUP(G,  ,.I) 
i i 

and  SIG  - E E 2(p  ) ^''^  E,  . (p,)^^^ 

i J<i  J 

The  individual  terms  in  SIG  for  specific  i and  J can  be  thought  of  as: 

1/2  1/2 

DSIG(i,j)  - 2(p^)''^  q^j(pj)  ' 


The  displayed  mathematics  for  the  calculation  of  MUP  are  for  the  expo- 
nential damage  law.  The  derivation  of  the  quantity,  MUP,  required  for 
use  of  the  square  root  damage  law  is  discussed  in  the  Derivation  of 
Square  Root  Damage  Function  section  of  this  chapter  and  are  not  of  any 
importance  in  this  discussion  of  correlation  effects. 
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I El  . 


wlilcli  wi>  identify  computationally  aa 


nSlC(k,J>  - 2*CJVM(i,j)*Mln  |sSIG(a  ,J)| 

k-i.j 

where  GAM(1*J).  H"'  nmxlmum  rlak  ahared  by  1 and  J,  la  eatlmated  as 
GAM(i,j)  • d(A^,Aj)*Mln  {rISK(A^  , J) , RISK(A^,Gj  ,J)} 


where  6,  the  Kroniker  d,  la  0 if  A^  -f  Aj,  and  1 if  - A^. 

The  simple  form  used  for  DSIG  above  implies  that  has  the  form; 


i.J 


Max 

F SM(L)' 

I.J 

L 

l i^Max  j 


,1/2 


however,  this  form  never  enters  explicitly  into  the  calculations. 

To  combine  this  treatment  for  the  analysis  of  weapon  correlations  with 
the  preceding  treatment  of  time  dependent  target  values  we  simply  use 
the  Sj  evaluated  above  to  supply  the  S(NI,J)  required  in  the  formula 

d-M  Nl-NN 

VT  - i:  r.  IV(NI,J)  - V(Nl  + l,J)]  * S(NI,J) 

J-1  NI-0 


The  weapons  to  be  included  in  the  evaluation  S.j.  for  any  N1  are  of  course 
those  on  the  target  tip  to  and  including  the  time  NI . 

This,  of  course,  requires  that  separate  sums  for  MU  and  SIG  be  maln- 
t (lined  for  each  relevant  time  Interval,  NI,  and  each  hardness  component 
,1.  'Unis  these  variables  are  actually  two  dimensional  arrays  MU(NI,J) 
and  S1G(NI,J).  Moreover,  every  potential  payoff  estimate  (both  for 
each  weapon  that  might  be  added,  and  for  eacfi  that  might  be  deleted) 
requires  a separate  complete  set  of  sums. 

Derivation  of  Damage  Functions 

A Universal  Damage  Function:  Consider  the  situation  for  which  the  lethal 
radius  and  CEP  of  a single  weapon  are  small  compared  to  the  target 
dimensions.  This  case  becomes  quite  pertinent  under  any  of  the  follow- 
ing circumstances: 

Very  large  cities 

Targets  whose  uncertainty  of  location  is  larger  than  the  area  of 
influence  of  a weapon 


4R3 


Employment  of  large  numbers  of  SEsall  weapons  (e.g,,  cluster  war- 
heads) 


Hardening  which  reduces  effective  weapon  radius  below  target  size 
(e.g.,  blast  shelters  for  urban  population). 

In  such  a situation,  where  the  value  denaity  of  the  target  does  not  vary 
significantly  over  the  area  of  effect  of  a single  weapon,  one  can  use- 
fully employ  the  concept  of  weapon  density  (weapons  targeted  per  unit 
area)  and  seek  the  weapon  density  as  a function  of  value  density  which 
optimizes  the  total  target  destruction  for  a given  total  number  of 
weapons. 

Before  such  an  optimization  can  be  effected,  however,  it  is  necessary  to 
obtain  the  relationship  between  the  weapon  density  applied  to  a sub- 
region,  expressed  for  convenience  as  the  fraction  of  the  original  value 
surviving.  In  the  most  general  case,  this  function  can  vary  with  posi- 
tion in  the  target,  reflecting  the  possibility  oi  varying  degrees  of 
vulnerability  over  the  target. 

We  Introduce  the  following  notation:  ! 

X Position  within  target  (x,  y coordinates) 

w(X)  Density  of  weapons  targeted  in  vicinity  of  X (number/ unit 
area) 

; 

V(X)  Target  value  density  in  vicinity  of  X (value/unit  area) 

F(cj)  Fraction  of  destruction  produced  by  weapon  density  u,  in 

the  absence  of  hardening 

M(X)  Vulnerability  (hardening)  factor  (Osftsl)  expressed  as 
effective  degradation  of  weapon  density 

W Total  number  of  weapons  intended  against  target. 

The  total  payoff  for  a given  weapon  density  distribution  is  then  given 
by: 

H = 


where  the  integration  is  understood  to  be  over  the  whole  target  area,  { 

and  dA  is  the  area  element.  i 

Similarly,  the  total  number  of  planned  weapons  is  given  by:  • 

W - 


I 


VF(^W)dA 


(1) 
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1; 

j 

(■ 


We  seek  now  the  weapon  density  distribution  which  maximizes  the  payoff 
for  a given  W.  Introducing  a Lagrange  multiplier  £0,  and  applying  the 
generalized  method  described  above,*  we  seek  the  weapon  density  function 
which  maximizes  the  unconstrained  Lagrangian. 

L - H - AW  (3) 

This  is  equivalent  to  maximizing: 


L - / [VF(w/i)  - Aa»]dA 

A 


The  density  function  0}\  which  maximizes  this  Lagrangian  for  a given  A 
Is  obtained  simply  by  maximizing  the  expression  inside  the  integral  at 
each  point  (see  cell  problem  discussion  in  Everett's  paper,  appendix  C), 
Ihe  optimum  density  at  any  point  is  therefore  a solution  of: 

bUX  - {vFOiw)  - Aa»|  (5) 

For  the  case  where  F is  monotone  increasing,  concave  (diminishing 
returns),  and  differentiable,  an  internal  maximum  of  (5)  can  be  sought 
by  zeroing  its  derivative: 


^ [VFOiW)  - Awl-  VF'Ojw^)  ii-W-0 


Letting  G ” (F')”^  stand  for  the  Inverse  function  of  the  derivative  of 
F leads  to; 

-X  -Jc  A <7, 

Equation  (7)  gives  the  internal  maximization  of  (5).  To  complete  the 
solution  we  must  account  for  the  constraint  u)*20  (negative  densities 
arc  not  allowed).  Thus  the  optimum  is  given  by  (5)  only  if  and  if 

VF(MW  ) - Au.  sO,  since  otherwise  (5)  is  maximized  by  w - 0.  The  com- 
plete solution  can  therefore  be  stated: 


p G ifoJX^O  VF(MW  ) -AWiO 


\ 0 otherwise 

(This  solution  is  also  valid  even  if  F is  not  concave  --  a situation  in 
which  G may  be  multivalued  --  provided  that  one  uses  that  value  of 
G(A/Vp)  for  which  VF(/iW)  -Xiois  a maximum.) 


I J 

It:  ' 


Oba«i'v«i  that  thw  optlmiuw  (t*n«lty  )|iv«n  by  (H)  In  « function  only  of  V 
itnd  Hud  1«  explicitly  Independent  of  poaltton,  If  we  cen  fnrtlier 
eaeuMe  that  the  vulnerability  la  a function  only  of  the  value  denulty 
V and  la  othervlae  Independent  of  poaltton,*  then  we  can  alwpllfy  the 
forwulatlou  and  aolutlon  aoiaewhat.  in  thla  caae,  all  pertinent  tncKot 
characterlatlca  are  auiwaarlaed  by  two  fmictlona: 

A(V)  •*  total  area  of  thoae  areaa  whoae  value  denalty 
la  greater  than  V 

M(V)  “ vulnerability  factor  aa  a fnnctlon  of  value  denalty 

The  optimum  weapon  denalty  given  hv  (d>  becomea  then  a function  only 
of  the  value  denalty  V; 


^0  and  VF(uw) 


' Xm 


|0  otherwise 


(y> 


and  the  total  payoff  and  total  weapona  are  given  In  the  alaiple  torm  of 
Stleltjea  Integrala; 


ii 


\ 


p(V))dA(V) 


dA(V) 


(U» 


Thla  completea  the  general  optlwlaatlon  of  weapon  denalty.  For  explicit 
aolotlona  we  require  apeclflc  tunctlona  for  the  target  value  dlatributlon 
function  A(V),  the  deatructlon  function  F(di),  and  the  vu  Inerahl  1 1 1 v 
dlatributlon  ^(V).  We  ahall  now  consider  several  pertinent  caaea. 


A 

Which  aaeaw  generally  quite  plaualble,  and  la  In  any  caae  certainly 
true  If  the  variation  of  M arlaea  from  opt  linlaat  Ion  ot  shelter  deploy- 
ment, for  example. 
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Locully  Kandom  Ii»p«ct  Model;  Wh«n  th«  CEP  I*  not  significantly  smaller 
than  the  lethal  radius,  or  when  the.  delivery  probability  of  Individual 
weapons  Is  low,  the  situation  over  any  homogeneous  part  of  the  target 
can  he  closely  approximated  bv  regarding  the  weapons  ns  having  been 
dropped  uniformly  at  random  ovar  that  part. 

Consider,  therefore,  a region  of  area  A (large  compared  to  the  lethal 
area  of  a single  weapon)  Into  which  N weapons  each  with  lethal  area 
nKg  and  delivery  probability  P are  delivered  uniformly  and  Independently 
at  random.  The  probability  that  any  given  point  In  the  region  will  sur- 
vive one  weapon  Is; 


S(l) 


p.r/ 

A 


(11) 


and,  since  weapon  arrivals  are  Independent  events,  the  probability  of 
surviving  N Is; 


S(N) 


p.r/ 

A 


) 


N 


(12) 


Introducing  the  parameters  K and  u)  : 

K • PnR^^  - expected  lethal  area  of  one  weapon 


(13) 


u ■ N/A  ■ weapon  density 


allows  (12)  to  be  written  as: 


5(0))  - 


N 


This  gives  for  the  destruction  function: 


Fj^(o))  ■ 1 - S(«) 


(lA) 


(15) 
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Equation  (IS)  still  contains  an  extra  parameter,  N,  which  Is  the  number 
of  weapons  In  the  area  A used  to  derive  (12)--presuaied  large  compared 
to  the  effects  of  a single  weapon  and  email  compared  to  the  total  target 
slse.  We  are  currently  Interested  In  the  limit  as  this  area  A becomes 
Infinite  compared  to  the  effects  of  a single  weapon,  hence  In  tlie  limit 
as  N — ►*: 


F„(m)  - lim  Fj^Cu.)  - 1 - e 
N— 

which  becomes  our  final  destruction  function  for  the  locally  random 
Impact  model. 

"Perfect"  Weapon  Model;  At  the  other  extreme  from  the  locally  random 
impact  model  Is  the  hypothetical  situation  where  the  weapons  have  tero 
CEP,  delivery  probability  of  unity,  and  completely  destroy  a hexagonal 
region  of  area  K with  no  damage  outside  the  region. 

This  situation  closely  resembles  the  case  of  "cookie-cutter"  weapons 
of  zero  CEP  and  unit  delivery  probability,  and  deviates  from  the  latter 
only  when  the  area  covered  Is  so  densely  packed  that  the  "cookie-cutter" 
circles  begin  to  over  lap- -which  does  not  occur  until  the  fractional 
coverage  exceeds  n/(2  or  about  .91. 

For  such  "perfect"  weapons  the  destruction  fraction  Is  given  by; 


01  < 1/K 

0)  > 1/K  (17) 


Intermediate  Cases:  We  have  considered  two  extremes,  locally  random 
Impact,  and  perfect  weapons.  For  actual  situations,  the  targeting  will 
not  be  random,  but  some  optimum  pattern  of  DCZs. 

As  the  CEP  becomes  larger  than  the  lethal  radius,  or  the  delivery  prob- 
ability becomes  small,  the  sltuatlon--even  though  based  on  a pattern  of 
DGZs--approaches  a situation  described  by  the  random  Impact  moded.  On 
the  other  hand,  for  high  delivery  probability  and  small  CEP,  the  situa- 
tion begins  to  approach  the  "perfect"  weapon  case--partlcularly  as  the 
weapon  effect  radius  becomes  sharp  (close  to  "cookle-cuf ter"--e.g. , the 
conventional  020  model). 

Returning  to  the  destruction  function  given  by  (15)  containing  the 
extra  parameter  N (from  which  the  random  model  was  obtained  by  letting 
N — ►*») , we  observe  the  remarkable  fact  that  for  N-1,  this  function  is 
precisely  the  damage  function  (17). 
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Since  this  function  contalni,  for  the  extreme  values  of  N,  the  two 
limits  we  have  considered,  it  seems  reasonable  to  suppose  that  any 
actual  intermediate  case  could  be  adequately  approximated  by  this 
function  for  some  intermediate  value  of  N. 

We  shall  accordingly  adopt  this  general  function  as  our  destruction 
function,  subject  to  subsequent  empirical  verification. 

The  general  law  therefore  becomes: 


(18) 


Kur  purposes  of  determining  the  optimum  distribution  of  weapon  density 
over  a target  of  varying  value  density  we  wish  to  employ  Eq.  (9),  for 
which  we  require  the  function  G ■ Accordingly, 


F'  («)  - — F^(«) 
N du)  N 


(19) 


for  which  the  inverse  function  is  easily  determined  to  be: 


rhus  from  (9),  the  optimum  weapon  density  is  given  by: 

(viW  ^ " (kVm(V))  N 
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and  for  which  Che  daatructlon  fraction  ia  aaaily  calculated; 


■ (kvu(V)) 


X \N/N-1 


This  completes  the  general  treatment  for  arbitrary  target  value  distri- 
butions. 

Gaussian  Targets;  A particularly  Important  special  case  is  that  of  a 
Gaussian  target,  for  which  the  value  density  distribution  is  given  by; 


V(x,y) 


1 ^.r2/2o2 


(The  total  value  is  hare  normalized  to  unity.)  From  (23)  we  determine 
the  relationship  between  radius  and  value  to  be; 


r^(V)  «=  -2o^  in(2Tro^V) 


and  hence  the  cumulative  area  distribution  function  to  be; 


A(V)  - Trr^(V)  » -2iro^  in(2ito^V)  for  V$— 

2 wo' 

and  the  differential  element  is: 


dA(V)  - - dV 

Solution  For  Constant  Vulnerability 
(22),  and  Ictllng  n = 1; 


Combining  Eq.  (10)  with  (26)  aiul 


H 


X 


1/(2wo2) 

/ V 1 


X/K 


1 


2iio^X 

K 


(27) 


Traas forming  the  Lagrange  multiplier  X to  a new  multiplier  g: 


2iio^X 


1/(N-1) 


we  can  rewrite  (27)  as: 


i"-*  [i 


Hg  - 1 - 6‘  " U ♦ (N-1)  ‘ (1 


-•'] 


(28) 


(29) 


The  total  numbar  of  weapons  as  given  by  (10),  (21),  and  (26): 


l/(2iro^) 


W, 


7 5 - (")n(^)'- 

X/K 


(30) 


leads,  in  terms  of  8,  to: 


W. 


N(N-l)2sq' 


^8  - jtn(6  - l)j 


(31) 


In  order  to  permit  explicit  exhibition  of  payoff  as  a function  of  num- 
ber of  weapons,  it  is  necessary  to  define  a new  function,  Y.  which 
is  the  inverse  of 


y - £ny  - 1 - x 


491 


(32) 


that  is,  y - V(x).  It  is  definad  for  all  nonnop/itlve  argiin»fius.  with 
values  on  the  interval  lero-one.  With  this  function,  (29)  and  (’31)  can 
be  rewritten,  in  terms  of  surviving  value: 


(33) 


Equations  (33)  summarise  the  relationship  between  surviving  fraction, 
S,  and  number  of  weapons  targeted,  W,  for  Gaussian  targets,  and  with  a 
model  parameter  N,  which  can  range  from  I to 

The  two  limiting  forms  of  (33),  corresponding  to  N - I and  N -► «»  are 
interesting  and  important,  and  are  easily  shown  to  be; 


Sj  ■ exp(-KW/2iio^) 


These  are  often  termed  the  power  law  (or  exponential  law)  and  the  square 
root  law,  respectively. 

Derivation  of  Kill  Probability  Function 

A variety  of  kill  probability  functions  are  in  general  use.  The  "normal 
model"  employs  a function  of  the  form: 


Pj,{r)  « e 


-r^/2o 


2 

K 


The  "cookie-cutter"  model  employs  a discontinuous  function; 


(34) 


P,(r) 


Rj.^r  ^0 


r>R^ 


(35) 
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where  Kk  is  the  ao-celled  "lechel  redlus."  The  relation  between 
and  is  obtained  by  equating  lethal  areas 


rdrdO 


(36) 


leading  to  Che  relation 


(37) 


ocher  functions  have  often  been  used  and,  indeed,  it  has  occasionally 
been  found  convenient  to  employ  a generalised  kill  function  of  the 
form: 


G^(r)  - 


W-1 

E 


j-O 


3l 


(38) 


where 


K 


Again,  we  can  equate  lethal  areas  to  relate  a with  R^: 


«P 

/ 


Gj^(r)  rdrde 


so  that 

for  all  W 


(39) 


(40) 


The  parameter  W serves  to  alter  the  shape  of  this  kill  probability 
curve.  Thus,  G|((r)  reduces  to  the  normal  curve  for  W ■ 1 and  the 
cookie-cutter  for  W — ►«».  Standard  kill  curves,  such  as  the  O20  and 
030  curves  of  AFM  200-8,  representing,  respectively,  ground  burst  and 
optimal  air  burst  blast  damage  probabilities  as  a function  of  distance, 
can  readily  be  approximated.  W - 6 approximates  closely  the  020  curve, 
and  W ••  3 approximates  the  030  curve. 
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Integration  of  a kill  probability  function  over  appropriate  dena  Ity 
functions  allows  the  representation  of  such  factors  as  delivery  error, 
geodetic  error,  extended  targets,  etc. 

Assume  an  extended  target  with  the  Gaussian  normal  value  distribution 
as  follows; 


V(r) 


2 2 

e- 


(41) 


V(r)  - value  per  unit  area  at  distance  r from  center 
* standard  deviation  of  value  distribution 

Igt 

Clearly: 


1.0 


2no, 


Tgt 


/ 


» 2 2 
■r  /2o_ 
e Tgt 


dr 


(41) 


Define  a radius,  R9S,  such  at  95%  of  the  value  of  the  target  is  con 
talned  within  this  distance  of  the  target  center.  (This  R95  Is  the 
target  radius  used  In  the  QUICK  system.) 


I e ' Tgt  dr  - .95  / e 


« 2,-2 

^^°Tgt  dr 


(43) 


Solving  this  equation  for  I-**  terras  of  R95,  we  get; 


Tgt 


Rgj/2.448 


Assume  a CEP,  the  radius  of  a circle  with  center  at  an  aiming  point 
which  will  contain  50%  of  the  centers  of  Impact  of  weapons  aimed  at 
the  aiming  point.  Assuming  a circular  normal  (Gaussian)  distribution 
of  the  aiming  errors: 


P(r) 


e 


-r^/2o 


2 

CEP 
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where 


p(r)  » probability  aiming  error  la  r 

0 - standard  deviation  of  aiming  errora 

Cbr 

Hy  definition  of  CEP 
■P 

plrl  dr  - 0.5 
Solving  for  1«  terms  CEP 

Ca  Ci  a 


Ocpp  - .8493  CEP 


Assume  a weapon  Is  aimed  at  the  center  of  the  target.  Prom  the  nature 

2 

of  the  Causalan  distribution  we  can  define  a standard  deviation  O'*  • 

2 2 

Op  -f  0-  such  that  the  circular  normal  distribution  characterised 
CEr  Tgt  2 

by  Op  Is  the  convolution  of  the  distributions  characterised  by 

•»<| 


Therefore,  If 


P»(W)  ■ probability  of  target  kill 
W - kill  function  parameter 
0„(r)  - kill  function  from  Eq.  (38) 

N 


then 


P,(W) 


m 

( 


(46) 


G|^(r)  rde 


Evaluating  the  Integrala 


APPENDIX  B 


OPTIMIZATION  OF  DGZs  FOR  COMl’LEX  TARGETS 


Miululo  ALOCOUT  Js  responsible  for  selecting  optimum  desired  ground  zeros 
DGZs)  for  weapons  allocated  to  complex  targets.  The  complex  target  may 
contain  several  component  target  elements,  each  with  specific  coordinates, 
hardness,  and  some  given  time  dependence  of  value.  To  place  this  diverse 
target  element  Information  on  a commensurate  basis  for  efficient  DGZ 
selection,  each  target  component  of  the  complex  is  represented  as  a 
series  of  simple  point  value  elements.  Complex  elements  with  more  than 
one  hardness  component  generate  more  than  one  such  target  element,  and 
area  targets  generate  several  elements,  spread  over  the  area  of  the  tar- 
get, to  represent  a value  spread  over  the  area.  A (DGZ)  Desired  Ground 
Zero  Selector  then  uses  the  data  to  select  optimum  aim  points  within  the 
target  complex. 

The  selection  of  DGZs  Is  a two-step  process.  First,  the  prescribed  war- 
heads are  assigned  Initial  coordinates  through  a "lay-down"  process  in 
which  each  successive  warhead  is  targeted  directly  against  the  target 
element  where  the  highest  payoff  Is  achieved,  taking  into  account  colla- 
teral damage  to  all  other  target  elements.  Second,  a general-purpose 
function  optimizer,  FINDMIN,  calculates  the  derivatives  of  the  payoff 
as  a function  of  x and  y coordinates  of  each  weapon  and  adjusts  the 
coordinates  to  minimize  the  surviving  target  value.  FINDMIN  terminates 
cither  after  a maximum  number  of  iterations  (which  can  be  specified  by 
Dir  analyst)  or  after  it  finds  that  it  can  no  longer  make  significant 
Improvements  in  tlie  payoff. 

The  mathematical  representation  used  is  as  follows. 

The  weapons  allocated  to  a complex  target  are  to  be  placed  in  a manner 
which  attempts  to  minimize  the  total  escaping  target  value.  To  simplify 
discussion,  the  notation  below  is  introduced.  A second  subscript,  j, 
referencing  the  target  element,  is  used  when  needed. 

= value  of  j target  element  remaining  immediately 
following  arrival  of  the  i^^  weapon 

= probability  of  survival  of  target  element  associ- 
ated with  weapon  i 

= amount  of  value  of  target  element  that  "escapes" 
between  arrival  of  weapons  i - 1 and  i 

“ time  of  arrival  of  weapon  i (Tq  Is  an  initial  time  when 
the  full  target  value  is  applied)  ^ all  i) 


V. 

J 
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Vj(T^)  « value  of  target,  at  time 
N - number  of  weapons 

NT  “ number  of  targets 


The  following  sketch  illustrates  the  treatment  of  the  time-dependent 
values  of  the  j target. 
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From  this  sketch,  the  following  relationships  should  be  apparent.  Ti»e 
equations  immediately  below  refer  to  a single  target  (,1),  but  for  slmpllc 
Ity  the  j subscript  is  omitted, 

Vi  » VCT.JS.V.  _ j/V(Ti  _ j)  (i  - 1,2 N) 

[l  - V(T.)/V(T. 


E.  . V. 


1 


,)  (i  - 1,2,  ....  N . n 


tin-  provlous  equations. 


■ i 

■ i 

r 1 

n v(T.) 

and  E.  ■ n S. 

lv(T._p  - V(Tj)J 

Lk»l  J 

[k-1 

rn' 


ih)  ‘ 


(For  i * 1,  the  product^  TI  Sj^  | is  understood  ■ 1.  Also  V(Tj^  + 
The  total  escaping  value  associated  with  target  j is 
N+1  N+l 


N+1  N+1  / fi-l  1 r 


) 


The  value  on  target  J which  escapes  after  arrival  of  weapon  1 Is  gl  'cii 
by 

N+1 

p=*l  + l 


The  effective  value  of  target  j associated  with  weapon  1 defined  by 


This  value  is  Introduced  for  computational  efficiency  and  may  be  thought 
of  as  the  total  value  available  for  weapon  i,  the  effect  of  all  other 
weapons  having  been  taken  into  account. 

The  marginal  value  picked  up  on  target  .1  due  to  weapon  1 Is  given  by 


Fyd 


where  S^j  la  a function  of,  among  other  things,  the  position  of  weapon  1. 
For  a fixed  weapon  configuration,  weapon  1 can  be  moved  from  (x,y)  to 
(x',y')  and  the  marginal  escaped  value  Is  given  by: 

NT 
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To  establish  an  Initial  weapon  configuration,  a lay-down  Is  performed  as 
follows.  Initially,  set  Sj4  - 1 for  all  i,  J.  Denote  by  the  sur- 
vival probability  of  the  k^n  target,  relative  to  the  ith  weapon,  when 
this  weapon  Is  placed  on  the  j^h  target.  Now  the  1th  weapon  Is  placed 
on  that  target,  J,  which  yields  a maximum  value  for  the  expression 

NT 

^ fik'Slk  - sk) 

The  are  now  set  to  equal  to  (k  - 1,2,...,  NT)  the  (all  1,  k) 
are  redetermined,  1 la  Increased  by  one,  and  the  process  repeated  until 
all  weapons  have  been  allocated. 

This  weapon  configuration  can  now  be  Input  as  the  initial  position  to  a 
"hill  climber"  routine,  based  on  a steepest  descent  algorithm,  which 
attempts  to  optimize  further  by  replacing  tlie  discrete  set  of  possible 
weapon  positions  with  tiie  two-dimensional  continuum.  The  function  to  be 
minimized  Is; 


NT 

N+l 

E 

E ^ 

i»l 

Processing  by  the  optimizer  will  be  terminated  either  when  the  optimum 
has  been  achieved  or  when  a specified  number  of  Iterations  have  been 
completed.  In  either  case,  to  Insure  that  the  local  optimum  obtained 
cannot  be  further  Improved,  the  value  of  removing,  in  sequence,  each  of 
the  weapons  from  its  final  location  and  placing  It  on  one  of  the  target 
points  Is  explored.  If  the  results  obtained  by  this  method  are  better 
than  those  achieved  wltli  the  previous  configuration,  this  new  assignment 
will  be  used  as  an  Initial  one  for  a second  utilization  of  subroutine 
FINDMIN.  If  not,  tlie  results  of  tlio  first  use  of  subroutine  FINDMIN 
will  be  kept. 
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APPENDIX  C 


GENERALIZED  LAGRANGE  MULTIPLIER  METHOD 
KOR  SOLVING  PROBLEMS  OF  OPTIMUM 
ALLOCATION  OF  RESOURCES 


Hugh  Everett  III 

U'eaponi  Etaluaiion  Divition,  InttUuU  for  Dtfenu  Aitalytto, 

Wothintton,  D.  C. 

(Received  August  30,  1063) 


The  usefulness  of  Lsgrsnge  multipliers  for  optimisstion  in  the  presence 
of  eonstrsints  is  not  limited  to  differentiable  functions.  They  can  be 
applied  to  problems  of  maximising  an  arbitrary  real  valued  objective  func- 
tion over  any  set  whatever,  subject  to  bounds  on  the  values  of  any  other 
6nite  collection  of  real  valued  functions  defined  on  the  same  set.  While 
the  use  of  the  Lagrange  multipliers  does  not  guarantee  that  a solution  will 
necessarily  be  found  for  all  problems,  it  is  ‘fail-safe*  in  the  sense  that  any 
solution  found  by  their  use  is  a true  solution.  Since  the  method  is  so  sim- 
ple compared  to  other  available  methods  it  is  often  worth  trying  first, 
snd  succeeds  in  a surprising  fraction  of  cases.  They  are  particularly 
well  suited  to  the  solution  of  problems  of  allocating  limited  resources 
among  a set  of  independent  activities. 

IN  MOST  textbook  treatments,  Lagrange  muitipliera  are  introduced  in  a 
context  of  diflerentiable  functions,  and  are  used  to  produce  constrained 
stationary  points.  Their  validity  or  usefulness  often  appears  to  be  con- 
nected with  differentiation  of  the  functions  to  be  optimised.  Many 
typical  operations-research  problems,  however,  involve  discontinuous 
or  nondi/Terentiable  functions  (integral  valued  functions,  for  example), 
which  must  be  optimised  subject  to  constraints. 

We  shall  show  that  with  a different  viewpoint  the  use  of  Lagrange  mul- 
tipliers constitutes  a technique  u-hose  goal  is  maximization  (rather  than 
location  of  stationary  points)  of  a function  with  constraints,  and  that  in 
this  light  there  are  no  restrictions  (such  as  continuity  or  differentiability) 
on  the  functions  to  be  maximised.  Indeed,  the  domain  of  the  function  to 
be  maximized  can  be  any  set  (of  any  cardinal  number)  whatever. 

The  basic  theorems  upon  which  the  techniques  to  be  presented  depend 
are  quite  simple  and  elementary,  and  it  seems  likely  that  some  of  them  may 
have  been  employed  previously.  However,  their  generality  and  appli- 
cability do  not  seem  to  be  well  understood  at  present  (to  operations  ana- 
lysts at  least) . The  presentation  will  consequently  place  primary  empha- 
sis on  the  implications  and  applications  of  the  basic  theorems,  as  well  as 
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discussion  of  a number  of  techniques  for  extending  the  usefulness  of  the 
methods. 


FOKMULATION 

Tor  clarity  of  presentation,  we  shall  develop  the  subject  in  a language 
of  problems  concerning  the  optimal  allocation  of  resources.  Other  appli- 
cations of  the  tlieoreins  will  suggest  themselves. 

Let  us  suppose  that  there  is  a set  S (completely  arbitrary)  that  is  in- 
terpreted as  the  set  of  possible  strategics  or  actions.  Defined  on  this 
strategy  set  is  a real  valued  function  H,  called  a payoff  function.  H(x) 
is  interpreted  as  the  payoff  (or  utility)  which  accrues  from  employing  the 
strategy  x<S.  In  addition,  there  are  n real  valued  functions  C^(k’^  1 - - -n) 
defined  on  i,  which  are  called  Retource  functions.  The  interpretation  of 
these  functions  is  that  employment  of  the  strategy  xtS  will  require  the 
expenditure  of  an  amount  C'fx)  of  the  Jkth  resource. 

The  problem  to  be  solved  is  the  maximization  of  the  payoff  subject  to 
given  constraints  c,k^l‘"n,  on  each  resource;  i.e.,  to  find 

W(x) 

subject  to  C*(x)  Se*.  all  k. 

A particular  subclass  of  this  general  problem  with  wide  application  is 
what  will  be  called  a cell  problem  (or  separable  problem)  in  which  there 
are  a number,  tn,  of  independent  areas  into  which  the  resources  may  be 
committed,  and  for  which  the  over-all  payoff  that  accrues  is  simply  the 
sum  of  the  payoffe  that  accrue  from  each  independent  venture  (cell). 
In  this  type  of  problem  we  have  as  before,  for  each  cell,  a strategy 
Si,  a payoff  function  Hi  defined  on  S,-,  and  n resource  functions  C,‘  defined 
on  Si.  Hi(xi)  is  the  payoff  in  the  ith  cell  for  employing  strategy  x,«5„ 
and  for  each  k,  C^(x,)  is  the  amount  of  the  itth  resource  expended  in  the 
Ith  cell  by  employing  strategy  x,  in  that  cell.  In  this  case  the  problem  to 
be  solved  is  to  find  a strategy  set,  one  element  for  each  cell,  which  maxi- 
mizes the  total  payoff  subject  to  constraints  c‘  on  the  total  resources  ex- 
pended; i.e., 

max 

• II 

subject  to  251"  C,*(x,)  i c*  for  all  A:. 

This  type  of  problem  is  simply  a subclass  of  the  previous  general  prob- 
lem since  it  can  be  translated  to  the  previo\is  problem  by  the  following 
identifications; 

115-7  S,  (direct  product  set). 
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(where  a strategy  x«S  consists  of  an  oi-dered  m-tiiple  (ji,  • ■ ar.)  of  strate- 
gies, one  for  each  Si] 

//(i)-E:::  w.(x.). 

c*(i)-E;rc/(x.).  alU 

MAIN  THEOREM  AND  SOME  OF  ITS  IMPLICATIONS 

We  now  present  the  main  theorem  concerning  the  use  of  Lagrange  mul- 
tipliers, and  discuss  its  meaning  and  implications.  The  proof  will  be  sup- 
plied in  a later  section. 

Theorem  1 

1.  X*,  Jk-  1,  n are  nonnegative  real  nutnbers, 

2.  z*<S  niaiimuee  the /unelion 

H(x)  - Drr  X*C‘(x)  over  all  x«S. 

X*  NioxtAitxM  H(x)  owr  all  thoeexti  tuch  that  C*  SC*(x*)  /or  all  k. 
DUcuiMton 

This  theorem  says,  for  any  choice  of  nonnegative  X*,  L - 1,  n,  that  if  an 
unconstrained  maximum  of  the  new  (Lagrangian)  function 

W(x)  - Etir  X*  (fix) 

can  be  found  (were  x*,  say,  is  a strategy  which  produces  the  maximum), 
then  this  solution  is  a solution  to  that  eonstraitied  maximisation  problem 
whose  constraints  are,  in  fact,  the  amount  of  each  resource  expended  in 
achieving  the  unconstrained  solution.  Thus  if  x*  produced  the  uncon- 
strained maximum,  and  required  resources  (fix*),  then  x*  itself  produces 
the  greatest  payoff  which  can  be  achieved  without  using  more  of  any  re- 
source than  I*  does. 

According  to  Theorem  1,  one  can  simply  choose  an  arbitrary  set  of  non- 
negative  X's,  find  an  unconstrained  maximum  of  the  modified  function, 
//(x)  — E*-"  C*(x),  ond  one  has  as  a result  a solution  to  a constrained 

problem.  Notice,  however,  that  the  particular  constrained  problem  which 
is  solved  is  not  known  in  advance,  but  arises  in  the  course  of  solution  and 
is,  in  fact,  the  problem  whose  constraints  equal  the  resources  expended  by 
the  strategy  that  solved  the  unconstrained  problem. 

In  general,  different  choices  of  the  X^’s  lead  to  different  lesource  levels, 
and  it  may  be  necessary  to  adjust  them  by  trial  and  error  to  achieve  any 
given  set  of  constraints  stated  in  advance. 

However,  it  is  noteworthy  that  in  most  operations-rcseai'ch  work  one 
is  not  simply  interested  in  achieving  the  optimum  payoff  for  some  given 
resource  levels,  but  rather  in  exploring  the  entire  range  of  what  can  be 


obtained  as  a function  of  the  resource  coinnutments.  In  this  case  it  matters 
little  whether  this  function  is  produced  by  solving  a spectrum  of  problents 
with  constraints  stated  in  advance,  or  by  simply  sweeping  through  the 
X^’s  to  solve  a spectrum  of  problems  whose  constraint  levels  are  produced 
in  the  course  of  solution.  The  method  when  applicable  is  therefore  (|uite 
efficient  if  the  whole  spectrum  of  constraints  is  to  be  investigated.  Even 
in  the  case  where  only  a single  constraint  set  is  of  interest  the  use  of  this 
method,  and  adjustment  of  the  X**8  until  the  constraint  set  is  achieved, 
is  often  more  efficient  than  alternative  procedures. 

A limitation  of  the  Lagrange  multiplier  method  arises  from  the  fact 
that  it  does  not  guarantee  that  an  answer  ran  Iw  found  in  every  case. 
It  simply  asserts  that  if  an  answer  can  be  found  it  will  indeed  be  optimum. 

In  cases  where  multiple  constraints  arc  involved  that  are  not  completely 
independent  it  may  not  be  possible  to  simultaneously  utilize  all  resources 
to  the  full  allowance  of  the  constraints.  This  can  happen  if  the  utiliza- 
tion of  one  resource  requires  the  utilization  of  others,  or  equivalently  in 
cases  where  some  constraints  may  involve  various  combinations  of  others. 
These  cases  are  analogous  to  problems  in  linear  programming  where  cer- 
tain constraints  prove  to  be  irrelevant  in  the  optimum  solution. 

In  such  eases  one  might  actually  find  the  optimum  solution  but  be  till- 
able to  establish  the  optimality  of  the  result  because  of  incompletely  util- 
ized resources.  Nevertheless,  there  is  a large  class  of  allocation  problems 
in  which  the  constraints  really  are  independent  (i.e.,  the  resources  can  l>e 
consumed  independently  in  the  region  of  interest).  In  such  cases  solu- 
tions can  usually  be  obtained  that  give  consumption  values  adecpiately 
close  to  the  constraint  values.  The  existence  of  optimum  solutions  that 
can  be  found  by  this  method  actually  depends  upon  an  approximate 
concavity  requirement  in  the  region  of  the  solution  that  will  be  discussed 
more  carefully  later. 

At  this  point  we  wish  to  remind  the  reader  of  the  generality  of  Theorem 
1.  There  are  no  reslrietime  whatever  on  the  nature  of  the  etrategy  eel  S, 
nor  on  the  Junctione  H and  (f  other  than  \eal-i<aluednese.  The  strategy 
set  may  therefore  be  a discrete  finite  set,  or  an  infinite  set  of  any  cardinal- 
ity. Furthermore,  the  payoff  function  and  the  resource  functions  can 
take  on  negative  as  well  as  positive  values.  |C*(x)  negative  may  be  inU'r- 
preted  as  production  rather  than  expenditure  of  the  kth  resource.] 

Application  to  Cell  Problem 

One  of  the  most  important  applications  of  Theorem  1 is  in  the  solu- 
tion of  cell  problems.  As  shown  in  the  Formulation  Section,  these  problems 
are  a subclass  of  the  general  problem  to  which  Theorem  1 is  applicnhle. 
In  this  case,  maximizing  the  unconstrained  Lagrangian  function 
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is  rquivsirnt  to  findiitg 

,.iD:r  «.(»•)!  - rt:f  x*ir::r  c.^x.)]. 

which  (interchanging  summation  order)  is  the  same  as; 

But,  since  the  choices  x,  nuy  be  nuide  independently  in  each  cell  as  a 
consequence  of  ^ obviously  maximized  by  simply 

maximizing 

«.(x.)-5:i:rx‘c.*(x.) 

PI  rafh  CfU  indfptndetxUy  oj  ttralegy  choices  in  other  cells,  and  Minuiiiiig  the 
payoffs  and  resources  exfieiided  for  each  cell  (for  the  strategy  that  maxi 
niizcd  the  Lagruiigian  for  that  cell)  to  get  the  total  payi^  and  ri'sourcc 
expenditures.  Theorem  I then  assures  us  that  the  result  of  this  process 
is  a solution  to  the  over  all  constrained  problem  with  constraints  equal  to 
the  total  rcsouri'cs  expended  by  the  strategy  produced  by  thw  procedure. 

Ob.serve  that  there  is  no  possibility  that  just  a local  maxiimini  to  the 
over  all  problem  has  lieen  obtained.  If  the  Lagrangian  in  each  cell  has 
been  correctly  maximized  (i.e.,  is  not  itself  merely  locally  maximized), 
then  theorem  1 guarantees  that  the  result  is  a global  maximum  to  the  over- 
all problem. 

Theorem  1 says  nothing  about  the  manner  in  which  one  obtains  the 
maxima  of  the  unconstrained  Lagrangian  functions,  but  simply  asserts 
that  if  oi>e  can  find  them,  then  one  can  also  have  maxima  of  a problem 
with  constraints.  The  Ijigrange  multipliers  therefore  are  not  a way  in 
themselves  of  finding  maxinuk,  but  a technique  for  converting  optimization 
problems  with  constrained  resources  into  unconstrained  maximization 
problems. 

This  conversion  is  especially  crucial  for  cell  problenrs  with  constraints 
on  total  resource  expenditures,  where  the  conversion  to  nnconstrainerl 
maximization  of  the  I^kgrangian  function  uncouples  what  was  an  essen- 
tially combinatorial  problem  (because  of  the  interaction  of  choices  in  each 
cell  through  total  tvsource  constraints)  into  a vastly  simpler  problem 
involving  independent  strategy  selections  in  each  cell. 

The  present  treatment  of  lagrange  multipliers  was  motivated,  in  fact, 
by  a cell  problem  involving  continuous,  differentiable  payoff  functions,  the 
solution  of  which  was  attempted  by  a classical  Lagrange  multiplier  ap- 
proach. In  this  case,  the  resulting  (transcendental)  equations  had  in 
noany  circumstances  a multiplicity  of  solutions,  and  the  emluirraasing 
problem  arose  as  to  which  of  several  solutions  to  select  for  each  cell.  It 
appeared  as  though  it  might  be  neceaaary  to  try  all  combinations  of  choices 
of  solutions— an  impoasible  task  in  this  case  which  involved  several  hun- 
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dred  c«lb.  As  s rrault  of  this  difficulty,  a closer  look  was  taken  at  the 
role  of  lAgrangc  multipliers,  and  the  present  treatment  is  the  result. 
The  oriipnal  problem  of  multiple  solutions  is,  of  course,  easily  solved  by 
simply  selecting  that  solution  in  each  cell  which  gives  the  Urgi'st  value 
for  the  Lograngian. 

It  is  the  recognition  that  the  objective  is  to  maxiiiuxe  the  l,agrangian, 
by  whatever  means,  not  to  sero  its  derivative,  which  is  decisive.  In 
many  coses  it  is  expeditious  to  maximise  the  lograngian  by  finding  seroes 
of  its  derivative.  One  can  then  easily  select  a final  value  by  testing  each 
solution  (if  there  is  more  than  one)  to  find  which  gives  the  largest  (global) 
nraximum.  This  procedure  autoiiurtically  excludes  any  solutions  that 
correspond  to  mininra  or  saddle  values,  and  also  facilitates  taking  into 
account  any  boundary  conditions  (such  os  nonnegative  resource  con- 
straints) by  testing  the  boundary  cases  os  well.f 

In  other  coses  (particularly  cases  of  nonnuincrical  strategies,  or  dis- 
crete strategy  sets  such  os  integers),  the  Lagrongion  may  l)est  be  maxi 
mised  by  trial  and  error  procedures,  or  even  direct  computer  scanning  of 
all  possibilities. 

Another  possibility  is  illustrated  by  cases  wherein  resources  may  l>e 
applied  only  in  integral  numbers.  Often  in  such  cases  one  can  define  a 
continuous  differentiable  payoff  function  that  attains  its  correct  value  on 
the  integers.  A useful  trick  applicable  to  many  such  cases  is  to  maximize 
analytically  the  Lagrangian  based  upon  the  continuous  function,  and  then 
test  the  integer  on  each  ude  of  the  solution,  selecting  the  one  that  maxi- 
mises the  lAgrangian. 

PROOF  OF  MAIN  THEORFM 

The  raoor  of  the  main  theorem  presented  and  discussed  in  the  previous 
section  is  quite  elementary  and  direct : 

Pro(^  cf  hfain  Theorem.  By  assumptions  (1)  and  (2)  of  Theorem  1, 
X*,  k - 1 • • -fi,  are  nonnegative  real  numbers,  and  z*«S  nwximizes 

W(x) xV(x) 

over  all  z«*  (the  i*  producing  the  maximum  may  very  well  not  be  unique - 
all  that  we  require  is  that  z*  be  some  element  that  nuiximizes  the  I<a- 
grangian) . This  means  that,  for  all  ZfS, 

«(x*)  -Zt;  X*  c*(z*)  i H{x)  x*  c‘(z) , 

t This  type  of  constrsiot  (r.g.,  nonnefativity  of  resources),  which  holds  inde- 
pendsnlly  for  each  cell  rather  than  over-all  as  with  total  resources,  is  handled  hy 
simply  reatrieting  the  strategy  set  for  the  cell  appropriately.  The  l<agrange  m\il 
tipliers  are  reserved  for  over-all  constraints. 
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and  hence,  that 

//(j*)  ^//(x)+5:t:r  x‘ic*(i*) -c*(x)) 
for  all  TtS.  But  if  the  latter  ine(|uaHty  is  true  for  all  JtS,  it  is  necessarily 
true  for  any  subset  of  S,  and  hence  true  on  that  subset  S*  of  S for 
which  the  resources  never  exceed  the  resources  C*(x*).  Notatioiially : 
xicS*<^  for  all  k,  (f(x)  SC*(x*).  However,  on  the  subset  S*  the  term 

D:rxV(i*)-c*(x)i 

is  nonnegative  by  definition  of  the  subset  and  the  nonuegativity  of  the 
x‘'s,  hence  our  incciuality  reduces  to  //(x*)^/f(x)  for  all  xt$*,  and  the 
theorem  is  proved. 


LAMBI>A  THEOREM 

Thkorem  2 

/.  Let  |Xi‘|,|Xj*|X‘=  1 • • -n  be  tu<o  sets  of  X*’s  that  produce  solutions 
X|*  and  xi*,  respectively.  Furthermore,  assume  that  the  resource  expenditures 
of  these  two  solutions  difer  in  only  the  jth  resource. 

r‘(x,*)  = <”*(x,*)  for  kp^j 
and  that  C'(xi*)  >(’'(xt*). 

£.  Then:  \t'^lH{x*) -li(Xt*)]/lCW)-CW)]^h,K 

This  theorem  states  that,  given  two  optimiiin  solutions  produeed  by 
Lagrange  multipliers  for  which  only  one  resource  expenditure  differs,  the 
ratio  of  the  change  in  optimum  payoff  to  the  change  ui  that  resource  ex- 
penditure is  bounded  l)etween  the  two  multipliers  that  correspond  to  the 
changed  resource. 

Thus  the  Lagrange  multipliers,  which  were  introduced  in  order  to 
con.sl min  the  re.source  expenditures,  in  fact  give  some  information  con- 
cerning the  effect  of  relaxing  the  constraints. 

In  particular,  if  the  set  of  solutions  produced  by  Lagrange  multipliers 
results  in  an  optimum  payoff  that  is  a differentiable  function  of  the  re- 
sources expended  at  some  point,  then  it  follows  from  Theorem  2 that  the 
./'s  at  this  point  are  in  fact  the  partial  derivatives  (or  total  derivative  in 
case  of  one  resource)  of  the  optimum  payoff  with  respect  to  each  resource 
(all  other  resources  kept  constant) : 

Proof.  The  proof  of  Theorem  2 is  also  quite  elementary.  By  hy- 
pothesis xi*  is  the  solution  produced  by  [X|*|,  hence  Xi*  maxinur.cs  the 
Lagrangian  for  |X|*|,  which  implies: 

H(x,*)  25  H{x)  +X/lC'(x,*)  -C'(x))+5:.,,,  X,‘lC*(x,*)  - C*(x) ) 
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holds  for  kII  i«S,  and  hence  in  particular  holds  for  x*.  But  since  hy  hy- 
pothesis C*(i|*)  -•C*(xt*)  for  kr^j,  we  can  deduce  that 

//(x,*)  -f  X,iC\x,*)  -r’(x,*)l. 

which,  since  by  hypothesis  C'fxi*)  >C'(x,*),  implies  that: 

lW<x,*)  - W(x.*)l/|C'<x,*)  -r*(x,')lSX,’. 

which  proves  one  side  of  the  conclusion  of  Theorem  2.  InterchanRing  the 
roles  of  X|*  and  X|*  (and  olnaerving  the  reversal  of  the  sign  of 

rW)-c'(x.*)) 

produces  the  other  side  of  the  inequality  to  complete  the  proof  of  Theorem 
■1 

An  obvious  conseqvience  of  Theoivin  2 is  the  fact  that,  if  all  but  one 
resource  level  is  held  constant,  the  resource  that  changes  is  a monotone 
dtcreanng  function  of  its  associated  multiplier.  This  fact  indicates  the 
direction  to  utake  changes  when  employing  a trial  and  error  method  of 
adjusting  the  multipliers  in  order  to  achieve  some  given  constraints  on 
the  resources. 

The  Iximbda  Theorem  also  suggests  a potentially  useful  technique  for 
choosing  a starting  set  of  multipliers  for  such  a trial-and-error  method  of 
achieving  given  constraint  levels  in  a cell  problem.  Beginning  with  any 
reasonably  good  allocation  of  the  given  resources,  one  can  often  calculate 
easily  what  the  effect  on  the  payoff  is  for  a small  additional  increment  of 
each  resource,  optinully  placed  within  the  cells.  The  differential  payoff 
divided  by  the  incrt'inent  of  resource  is  then  taken  as  the  starting  X for 
that  resource.  The  X’s  arc  then  adjusted  by  trial  and  error  vintil  the 
Lagrwnge  solution  corresponds  to  the  given  comstrainta,  producing  the 
optimum  allocation. 


THE  EPSILON  THEOREM 

A NATURAL  question  with  respect  to  the  pi..ctical  application  of  the 
Ixtgrange  method  concerns  its  stability— supposing  that  as  a result  of 
methods  of  calculation  or  appro.xiination  one  cannot  preciarly  maximise 
the  Lagrangian,  but  can  only  guarantee  to  achieve  a value  close  to  the 
maximum.  Such  a solution  can  very  well  1m*  at  a drastically  different 
resource  level  and  payoff  than  that  which  actually  achieves  the  maximum, 
and  yet  produce  a value  of  the  lagrangian  very  near  to  the  nwximum. 
For  the  n^ethod  to  Iw  practical,  it  is  required  that  in  this  situation  a solu- 
tion that  nearly  tiwximiies  the  lagrangian  inu.st  be  a solution  that  also 
nearly  nraximises  the  payoff  for  the  resource  levels  that  t(  ittelf  produces 
(which  n\ay  t>e  quite  different  than  tluw  of  the  solution  that  actually 
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))iaxinuzt‘s  the  Lagrangian).  Only  in  such  a circunislance  would  it  be 
safe  to  assert  that  the  solutions  produced  by  any  nonexact  procedures 
(such  as  numerical  computation  with  finite  accuracy,  or  methods  based 
upon  approximations)  were  in  fact  approximately  optimal  solutions  to  the 
constrained  problem.  Such  required  assurance  of  insensitivity  is  supplied 
by  the  following  (‘epsilon’)  theorem. 

T»\eore»»  3 

].  i comes  xcithin  « oj  maiiminng  the  Lagrangian,  i.e., /or  all  xtS: 

H(i)  -Z  X*C*(f)  >tf(i)  -E  X*C*(x)  - .. 

I is  a solution  0/  the  constrained  problem  xrith  constraints 
that  IS  itself  u'ithin  « of  the  wioximum  for  those  constraints. 

The  proof  of  this  theorem,  which  is  a simple  extension  of  Theorem  1. 
exactly  parallels  the  proof  of  Theorem  1 (with  an  added  «)  and  will  not 
be  repeated. 

ADDITIONAL  REMARKS,  CONCLUSIONS.  AND  COMPUTATIONAL 

PLOYS 

Gaps  or  Inaccessible  Regions 

Theorem  1 assures  us  that  any  ntaximum  of  the  Lagrangian  necessarily 
is  a solution  of  the  constrained  maximum  problem  for  constn>.ints  equal  to 
the  re.source  levels  expended  in  maximizing  the  Lagrangian. 

The  Lagrange  multiplier  method  therefore  generates  a mapping  of  the 
space  of  lambda  vectors  (components  X*,  1,  • • •,  n)  into  the  space  of 

constraint  vectors  (components  c‘,  it •*  1 • ■ ■ n).  There  is  no  a priori 
guarantee,  however,  that  this  mapping  is  onto — for  a given  problem  there 
utay  be  inaccessible  regions  (called  gaps)  consisting  of  constraint  vectors 
that  are  not  generated  by  any  X vectors.  Optimum  payoffs  for  constraints 
inside  such  inaccessible  regions  can  therefore  not  be  discovered  by  straight- 
forward application  of  the  Lagrange  multiplier  method,  and  must  hence 
be  sought  by  other  means. 

The  basic  cause  of  an  inaccessible  region  is  nonconcavity  in  the  function 
of  optimum  payoff  vs.  resource  constraints  (convexities  in  the  envelope 
of  the  set  of  achievable  payoff  points  in  the  space  of  payoff  vs.  constraint 
levels) . This  possibility,  and  several  methods  for  dealing  with  it,  will  now 
be  investigated. 

Before  beginning  this  investigation,  however,  we  wish  to  point  out  that 
even  though  the  Lagrange  multiplier  method  is  not  certain  to  obtain  the 
desired  solutions  in  all  cases,  any  solutions  that  it  does  yield  are  guar- 
anteed by  Theorem  1 to  be  true  solutions.  The  procedure  is  therefore 
‘fail  safe,’  a very  reassuring  property.  It  has  been  our  experience  ox’er 
the  last  several  years,  which  includes  application  of  this  method  to  a variety 
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of  production  and  military  allocation  problents,  that  the  mctlio<l  lius  IxH'n 
extremely  successful,  and  nearly  always  has  directly  yielded  all  solutions 
of  interest.  The  few  situations  in  which  the  direct  method  failed  were 
readily  solved  by  simple  modifications  to  the  proc»*dure,  some  of  which 
will  now  be  mentioned. 

Source  oj  Caps 

Consider  the  (n+1)  dimensional  space  of  payoff  \'s.  resource  ex|)endi. 
tures.  This  8p.ace  will  be  called  I’R  space  for  brex’ity.  Every  .strategy 
Hi  maps  into  a point  in  thb  space  eorre.sponding  to  //(x),r*(x)(A  « 1 • n). 
The  entire  problem  is  therefore  represented  by  this  set  of  acees-sible  points 
in  I’R  space.  The  problem  of  finding  the  maximum  of  H subject  to  con- 
straints c*,  Jt-  1 • • •«,  is  simply  the  problem  of  selecting  that  point  of  our 
set  in  PR  space  of  maximum  //  that  is  contained  in  the  subs|>ace  of  Pit 
space  aherc  the  re.sourees  are  l)ounded  by  the  f*'s.  The  8<'t  of  all  such 
points  (corresponding  to  all  sets  of  t allies  in  the  c‘'s)  will  lie  enllcd  the 
emtlopf,  and  constitutes  the  entire  set  of  solutions  for  all  possible  eon 
straint  levels. 

Consider  now  any  solution  x*  prinluced  by  a set  of  Lagrangt'  mulii- 
pliers  (\*).  By  definition  x*  nuiximizes  the  Ixigningian;  eonsequcntly 
we  have  that 

//(J-*)  -L  X‘  C*(x*)  a H(x)  X*  r*(x) 
for  all  Hi.  Rearranging  terms  slightly,  we  have; 

//(x)  i //(X*)  -Z  X*  ('‘(X*)  +E  X*  ('‘(X) 

for  all  x«S.  If  we  consider  now  the  hyperplane  in  PR  space  defined  by 
//••]^X*r*  + n where  <»•» //(x*)— 22 X* C*(x*),  we  see  that,  because  of 
the  previous  inequality,  none  of  the  accessible  points  in  PR  space  lies 
above  this  hyperplane,  and  at  least  one  point,  //(x*),(’*(x*)  A * I • • n, 
lies  on  it. 

Each  solution  proilueed  by  [aigrange  multipliers  therefore  defines  a 
Imunding  hyperplane  that  is  tangent  to  the  set  of  accessible  points  in  PR 
space  at  the  point  corresponding  to  the  solution  (hence  tangent  to  the 
envelope),  and  which  constitutes  an  upper  liound  to  the  entire  set  of  ac- 
cessible points.  It  is  clear  that,  since  no  such  tangent  bounding  hyper- 
planes exist  in  regions  where  the  envelope  of  accessible  points  in  PR  sp.aee 
is  not  concave,  the  lagrange  multiplier  method  cannot  produce  solutions 
in  such  a region.  Conversely,  for  any  point  on  the  envelope  (solutioni 
where  a tangent  iKiiinding  hyperplane  does  exist  (envelope  concave  at 
the  point),  it  is  obvious  that  there  exists  a set  of  multipliers  (namely  the 
slopes  of  the  hyperplane)  for  which  the  strategy'  corresponding  to  the  point 
in  question  maximises  the  Ixigrangian. 
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Tliti^  till'  IjittriiMKi'  iiii'tluHl  will  bitcceod  in  prtKiiu'iiiK  uH  solutions  that 
ooriospond  to  concave  regions  of  the  envelope  (uptiniizod  payoff  vs.  con- 
straint leveM,  and  fail  in  all  nonconcave  rt'gions. 

A fortunate  feature  of  cell  problems  with  many  colls  is  the  fact  that, 
c\en  though  there  may  tie  large  convexities  in  the  envelope  in  the  I’R 
space  for  each  cell,  the  result  of  over-all  optimiiation  is  an  envelope  in  the 
rU  space  for  the  total  problem  in  which  the  convexities  art'  vastly  reduced 
in  significance. t This  property  is  the  major  reason  for  the  general  success 
of  the  Uagrange  method  in  solving  cell  problems. 

.''orrie  Methods  for  Handling  Oapa 

Despite  the  general  succom  of  Ijigmnge  multipliers  (at  least  for  the 
problems  we  have  encountered),  occasions  may  arise  where  gaps  wcur  in 
regions  of  critical  interest.  I’nder  such  circumstances  there  are  several 
useful  techniques  that  cun  be  attempted  liefore  almndoning  the  procedure 
altogether. 

First,  nil  solutions  that  can  l>e  obtained  outside  the  gaps  contribute  a 
good  deal  of  infornuition  and  can  Ih'  used  to  bound  tlie  solution  in  the  gap 
region,  .-ts  was  pretiously  shown,  each  solution  that  cnti  1k>  obtained  by 
Uagratige  multipliers  defines  a bounding  Ityjierplane  that  gives  an  iiptH'r 
bound  to  the  maximum  payoff  at  all  |x>ints.  and  hence  inside  the  gap  as 
well  For  any  point  uiside  a gap,  therefore,  an  upper  bound  can  lie  ob- 
tained by  finding  the  minimum  payoff  for  that  point  over  the  set  of  bound- 
ing liyjxerphines  corresponding  to  the  solutions  that  one  cotild  calculate. 

On  the  other  hand,  every  solution  that  can  be  obtained  that  has  the 
property  that  none  of  its  resource  expenditures  exceeds  the  resources  of  a 
point  in  a gap  for  which  one  is  seek'mg  bounds,  obviously  constitutes  a 
hwr  bound  to  the  optimum  payoff  at  the  point  in  question,  and  the  ntaxi- 
mnm  of  these  lower  bounds  can  be  selected  as  a lower  bound  to  the  payoff 
in  question.  Thus  the  set  of  solutions  that  can  be  obtained  by  I^igrange 
multipliers  can  l>e  used  to  obtain  bounds  on  the  optiniunt  payoff  for  inac- 
cessible regions. 

There  is  another  technique  that  is  often  successful  in  reducing  gaps  in 
instances  where  the  bounds  one  can  compute  leaxe  too  large  a region  of 
uncertainty,  and  where  the  gap  is  caused  by  degeneracy  in  which  a numlier 
of  cells  hax'c  gaps  corresponding  to  the  .same  multiplier.  A gap  is  cliar- 

t In  f»ct,  the  (t;ip  structure  for  the  uver  hII  |>r«>l>lcm  ol>vu>iis\y  simply  reflect* 
f»ithfiill\  the  gap  ftriictiire  in  the  individual  cells,  with  each  gap  in  a cell  correspond- 
ing le  a given  multiplier  value  occurring  with  the  same  magiiiliide  (same  jump  in 
payi'fl  and  roovirce*'  in  the  over  all  oplimication  at  precisely  the  same  iniiltiplier 
value.  Only  degeneracies  in  which  several  cells  have  gaps  corresponding  to  the 
same  miilliplirr  can  cause  a larger  gap  in  the  over  all  prol'leni.  and  such  degeneracy 
is  ea.'ily  removed  liy  techniques  to  l>e  discussed  in  the  following  section. 
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actcrizcd  by  the  behavior  that,  as  the  X’s  are  continuously  varied,  there 
are  abrupt  discontinuities  in  tlie  resource  levels  generated.  These  dis- 
continuities can  often  be  filled  in  cell  problems  by  the  following  technique. 

Given  two  sots  of  X’8,(Xi*),(Xt*).  which  are  very  close,  but  for  which 
the  generated  resource  levels  markedly  differ,  one  can  make  a mixed  cal- 
culation in  a cell  problem  using  the  set  (X|‘)  in  some  cells  and  the  set 
(X|‘)  in  the  others.  If  the  two  sets  of  X’s  are  close  together,  maximizing 
the  Lagrangian  in  any  cell  for  one  aet  will  necessarily  result  in  a solution 
that  nearly  maximizes  the  Lagrangian  for  the  other  set,  hence  by  the 
Epsilon  Theorem  will  yield  a result  that  is  guaranteed  to  be  nearly  optimum. 

Somewhat  more  generally,  one  can  simply  exploit  the  Epsilon  Theorem 
directly  in  a cell  problem,  working  with  a given  set  of  X’s  but  deliberately 
modifying  the  choices  in  some  or  all  cells  in  a way  which  moves  in  the 
direction  of  the  desired  expenditure  of  resources.  By  sumnung  the  devia- 
tions from  maximum  of  the  Lagrangian  in  each  cell  (epsilons)  in  which 
the  strategies  are  so  modified,  a bound  on  the  error  of  the  result  is  obtained 
(which  can  be  kept  quite  small  in  most  cases  by  judicious  choice  of  devia- 
tions) . This  appears  to  be  a quite  powerful  strategem. 
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